An improved hadoop load rebalancer
نویسندگان
چکیده
منابع مشابه
An Improved Hadoop Data Load Balancing Algorithm
Data load balancing is one of the key problems of big data technology. As a big data application, Hadoop has had many successful applications. HDFS is Hadoop Distributed File System and has the load balancing procedure which can balance the storage load on each machine. However, this method cannot balance the overload rack preferentially, and so it is likely to cause the breakdown of overload m...
متن کاملAn Improved Data Placement Strategy in a Heterogeneous Hadoop Cluster
Hadoop Distributed File System (HDFS) is designed to store big data reliably, and to stream these data at high bandwidth to user applications. However, the default HDFS block placement policy assumes that all nodes in the cluster are homogeneous, and randomly place blocks without considering any nodes’ resource characteristics, which decreases self-adaptability of the system. In this paper, we ...
متن کاملAn Improved Under-Frequency Load Shedding Scheme in Distribution Networks with Distributed Generation
When a distribution network consisting of Distributed Generations (DGs) is disconnected from upstream network, the system may be exposed to severe power imbalance. In order to prevent the damage of power plants, frequency relays operate and remove DGs from the network. In contrast to traditional methods, the main objective in new methods is to keep DG units in service in the islanded distributi...
متن کاملThe Improved Job Scheduling Algorithm of Hadoop Platform
[Abstract] This paper discussed some job scheduling algorithms for Hadoop platform, and proposed a jobs scheduling optimization algorithm based on Bayes Classification viewing the shortcoming of those algorithms which are used. The proposed algorithm can be summarized as follows. In the scheduling algorithm based on Bayes Classification, the jobs in job queue will be classified into bad job and...
متن کاملSurvey on Improved Scheduling in Hadoop MapReduce in Cloud Environments
Cloud Computing is emerging as a new computational paradigm shift. Hadoop-MapReduce has become a powerful Computation Model for processing large data on distributed commodity hardware clusters such as Clouds. In all Hadoop implementations, the default FIFO scheduler is available where jobs are scheduled in FIFO order with support for other priority based schedulers also. In this paper we study ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Engineering & Technology
سال: 2018
ISSN: 2227-524X
DOI: 10.14419/ijet.v7i2.27.11775